Machine learning in Magnetic Resonance Imaging: Image reconstruction.

Magnetic Resonance Imaging (MRI) plays a vital role in diagnosis, management and monitoring of many diseases. However, it is an inherently slow imaging technique. Over the last 20 years, parallel imaging, temporal encoding and compressed sensing have enabled substantial speed-ups in the acquisition of MRI data, by accurately recovering missing lines of k-space data. However, clinical uptake of vastly accelerated acquisitions has been limited, in particular in compressed sensing, due to the time-consuming nature of the reconstructions and unnatural looking images. Following the success of machine learning in a wide range of imaging tasks, there has been a recent explosion in the use of machine learning in the field of MRI image reconstruction. A wide range of approaches have been proposed, which can be applied in k-space and/or image-space. Promising results have been demonstrated from a range of methods, enabling natural looking images and rapid computation. In this review article we summarize the current machine learning approaches used in MRI reconstruction, discuss their drawbacks, clinical applications, and current trends

Reducing Contrast Agent Dose in Cardiovascular MR Angiography with Deep Learning

BACKGROUND: Contrast-enhanced magnetic resonance angiography (MRA) is used to assess various cardiovascular conditions. However, gadolinium-based contrast agents (GBCAs) carry a risk of dose-related adverse effects. PURPOSE: To develop a deep learning method to reduce GBCA dose by 80%. STUDY TYPE: Retrospective and prospective. POPULATION: A total of 1157 retrospective and 40 prospective congenital heart disease patients for training/validation and testing, respectively. FIELD STRENGTH/SEQUENCE: A 1.5 T, T1-weighted three-dimensional (3D) gradient echo. ASSESSMENT: A neural network was trained to enhance low-dose (LD) 3D MRA using retrospective synthetic data and tested with prospective LD data. Image quality for LD (LD-MRA), enhanced LD (ELD-MRA), and high-dose (HD-MRA) was assessed in terms of signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), and a quantitative measure of edge sharpness and scored for perceptual sharpness and contrast on a 1-5 scale. Diagnostic confidence was assessed on a 1-3 scale. LD- and ELD-MRA were assessed against HD-MRA for sensitivity/specificity and agreement of vessel diameter measurements (aorta and pulmonary arteries). STATISTICAL TESTS: SNR, CNR, edge sharpness, and vessel diameters were compared between LD-, ELD-, and HD-MRA using one-way repeated measures analysis of variance with post-hoc t-tests. Perceptual quality and diagnostic confidence were compared using Friedman's test with post-hoc Wilcoxon signed-rank tests. Sensitivity/specificity was compared using McNemar's test. Agreement of vessel diameters was assessed using Bland-Altman analysis. RESULTS: SNR, CNR, edge sharpness, perceptual sharpness, and perceptual contrast were lower (P < 0.05) for LD-MRA compared to ELD-MRA and HD-MRA. SNR, CNR, edge sharpness, and perceptual contrast were comparable between ELD and HD-MRA, but perceptual sharpness was significantly lower. Sensitivity/specificity was 0.824/0.921 for LD-MRA and 0.882/0.960 for ELD-MRA. Diagnostic confidence was 2.72, 2.85, and 2.92 for LD, ELD, and HD-MRA, respectively (PLD-ELD , PLD-HD < 0.05). Vessel diameter measurements were comparable, with biases of 0.238 (LD-MRA) and 0.278 mm (ELD-MRA). DATA CONCLUSION: Deep learning can improve contrast in LD cardiovascular MRA. LEVEL OF EVIDENCE LEVEL: 2 TECHNICAL EFFICACY: Stage 2

Deep artifact suppression for spiral real-time phase contrast cardiac magnetic resonance imaging in congenital heart disease

PURPOSE: Real-time spiral phase contrast MR (PCMR) enables rapid free-breathing assessment of flow. Target spatial and temporal resolutions require high acceleration rates often leading to long reconstruction times. Here we propose a deep artifact suppression framework for fast and accurate flow quantification. METHODS: U-Nets were trained for deep artifact suppression using 520 breath-hold gated spiral PCMR aortic datasets collected in congenital heart disease patients. Two spiral trajectories (uniform and perturbed) and two losses (Mean Absolute Error -MAE- and average structural similarity index measurement -SSIM-) were compared in synthetic data in terms of MAE, peak SNR (PSNR) and SSIM. Perturbed spiral PCMR was prospectively acquired in 20 patients. Stroke Volume (SV), peak mean velocity and edge sharpness measurements were compared to Compressed Sensing (CS) and Cartesian reference. RESULTS: In synthetic data, perturbed spiral consistently outperformed uniform spiral for the different image metrics. U-Net MAE showed better MAE and PSNR while U-Net SSIM showed higher SSIM based metrics. In-vivo, there were no significant differences in SV between any of the real-time reconstructions and the reference standard Cartesian data. However, U-Net SSIM had better image sharpness and lower biases for peak velocity when compared to U-Net MAE. Reconstruction of 96 frames took ~59 s for CS and 3.9 s for U-Nets. CONCLUSION: Deep artifact suppression of complex valued images using an SSIM based loss was successfully demonstrated in a cohort of congenital heart disease patients for fast and accurate flow quantification

Machine learning in Magnetic Resonance Imaging:image reconstruction

Abstract Magnetic Resonance Imaging (MRI) plays a vital role in diagnosis, management and monitoring of many diseases. However, it is an inherently slow imaging technique. Over the last 20 years, parallel imaging, temporal encoding and compressed sensing have enabled substantial speed-ups in the acquisition of MRI data, by accurately recovering missing lines of k-space data. However, clinical uptake of vastly accelerated acquisitions has been limited, in particular in compressed sensing, due to the time-consuming nature of the reconstructions and unnatural looking images. Following the success of machine learning in a wide range of imaging tasks, there has been a recent explosion in the use of machine learning in the field of MRI image reconstruction. A wide range of approaches have been proposed, which can be applied in k-space and/or image-space. Promising results have been demonstrated from a range of methods, enabling natural looking images and rapid computation. In this review article we summarize the current machine learning approaches used in MRI reconstruction, discuss their drawbacks, clinical applications, and current trends

Real‐time deep artifact suppression using recurrent U‐Nets for low‐latency cardiac MRI

PURPOSE: Real-time low latency MRI is performed to guide various cardiac interventions. Real-time acquisitions often require iterative image reconstruction strategies, which lead to long reconstruction times. In this study, we aim to reconstruct highly undersampled radial real-time data with low latency using deep learning. METHODS: A 2D U-Net with convolutional long short-term memory layers is proposed to exploit spatial and preceding temporal information to reconstruct highly accelerated tiny golden radial data with low latency. The network was trained using a dataset of breath-hold CINE data (including 770 time series from 7 different orientations). Synthetic paired data were created by retrospectively undersampling the magnitude images, and the network was trained to recover the target images. In the spirit of interventional imaging, the network was trained and tested for varying acceleration rates and orientations. Data were prospectively acquired and reconstructed in real time in 1 healthy subject interactively and in 3 patients who underwent catheterization. Images were visually compared to sliding window and compressed sensing reconstructions and a conventional Cartesian real-time sequence. RESULTS: The proposed network generalized well to different acceleration rates and unseen orientations for all considered metrics in simulated data (less than 4% reduction in structural similarity index compared to similar acceleration and orientation-specific networks). The proposed reconstruction was demonstrated interactively, successfully depicting catheters in vivo with low latency (39 ms, including 19 ms for deep artifact suppression) and an image quality comparing favorably to other reconstructions. CONCLUSION: Deep artifact suppression was successfully demonstrated in the time-critical application of non-Cartesian real-time interventional cardiac MR